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Abstract 

Previous research has shown that, despite the importance of programming 
education, there is limited research done on programming education 
experiences from the students’ point of view and the need to do so is strong. 
By understanding the student behaviour, their learning styles, their 
expectation and motivation to learn, the quality of teaching can be improved. 
The goal of this paper is to examine the connection between educational 
theories and student-centred pedagogy’ via an empirical study. While 
research results have confirmed student difficulties in learning programming 
in terms of the retention and completion rates of the programming courses, 
we will propose some of the solutions to overcome these challenges. We will 
also classify the various definitions of learning goals both theoretically and 
empirically in order to further our understanding in the subject field. New 
research opportunities are opened in the applied work of a personalised 
learn ing environment. 
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Introduction 

Lister and Leaney (2003) suggested that, from the teacher’s point of view, one of the primary 
goals of programming courses is to equip students with the skill to develop programs to solve 
computing problems expressed both in programming and non-programming terms. From the 
student’s point of view, learning goals reflect individual motivation (Pintrich, 2003; Xia & 
Liitiainen, 2014). Goals are set in order to reach a specific performance outcome. In programming 
education, having clearly defined goals motivates learning and thus enables successful learning 
outcomes. (Locke & Latham, 2006) As a matter of fact, learning outcomes can be defined in 
general as acting as a benchmark for ensuring teaching quality (Maher, 2004; Xia, 2013). 

Bruse et al. (2004) defined learning as deepening one’s personal experience of a given 
phenomenon and teaching as enhancing the students’ experience of the given phenomenon through 
the alignment of critical dimensions in these experiences. Specifically, the primary goal of 
teaching in introductory programming education is to support learners to learn programming 
concepts and obtain useful programming skills. However, previous research has demonstrated a 
high student failure rate in terms of the course completion and retention rates as a major concern of 
these programming courses (Bruse et al., 2004). Some of the challenges associated with the 
programming courses are: 
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• Difficulties in reading and writing program codes: In order to be able to write correct 
program codes, students need to be able to first read program codes, which is one of the main 
challenges of programming education especially for those with no prior computer science 
background (Buck & Stucki, 2000). 

• Difficulties in designing program statements: Programming students fail to learn to write and 
design programs as programming skills are cognitively complex skills that require a deep 
understanding of structurally complex content (Dehnadi & Bornat, 2006). 

• Difficulties in tracing the program codes: Research results have shown that a large group of 
students could not trace through the programs in a systematic manner upon request. This 
phenomenon is especially evident among the novice programmers (Lister & Leaney, 2003). 

• Difficulties with grasping programming concepts: Misconceptions exist related to the 
architecture of computers and semantics students found difficult to grasp, such as what the 
assignment statement in Java does, understanding of recursion as a program construct, of what 
an object is and of how a given C program executes (Booth, 1992). 

Robins (2010) emphasised that the quality of learning can be improved by setting specific and 
measurable learning goals. These goals are especially important in programming education and 
there is a pressing need for further research (Krathwohl, 2002). The goal of this paper is to 
evaluate how students’ background influences their attitude towards programming and their 
learning preferences via an empirical study. The results of the present study will add to instructors’ 
and researchers’ knowledge in establishing a more personalised learning environment for the 
students in higher education. This paper is organised as follows. We will introduce our conceptual 
framework for this study based on the literature review on learning goals in programming 
education after defining the objective of this study. Then, we will elaborate on the data and method 
used in this study. Thereafter, we will discuss our research results and link their impact with the 
previous literature on the subject matter. 

The research question in this study is formulated as follows: What are the different factors that 
affect the kind of learning goals students set for themselves in programming education? The aim 
of this research is to deepen our knowledge in the field of programming pedagogy through an in- 
depth analysis of students’ experience in programming education. 

Background 

In 1956, Benjamin Bloom established the following six levels of taxonomy from lowest to the 
highest that is still widely used in understanding student learning of programming in terms of 
learning goals of the cognitive branch of the taxonomy. In programming education. Bloom’s 
Taxonomy is used to motivate improvements to the quality of the programming courses and 
understand the learning of programming along with the appropriateness of different assessment 
forms (Bloom, Engelhart, Furst, Hill, & Krathwohl, 1956). In particular, Bloom’s Taxonomy was 
created to emphasise that learning goals should be set at all level of the taxonomy and at different 
stages of learning. The Bloom original taxonomy included: 

• Knowledge: the student can remember, name and define specific facts or methods. 

• Comprehension: the student can interpret, explain and discuss the meaning of certain 
concepts or facts. 

• Application: the student can solve problems and produce solutions by applying knowledge to 
new situations. 

• Analysis: the student can break down, analyse and infer information into meaningful pieces in 
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order to determine the motives or causes of their relationships. 

• Synthesis: the student can create, compose and invent new information from the existing 
knowledge. 

• Evaluation: the student can evaluate, appraise and compare different arguments in light of a 
set of criteria in order to judgment of the given information. 

Code-tracing skills, for instance, are represented in Bloom’s Taxonomy through comprehension 
(being able to understand) and analysis (being able to analyse program-writing assignments of 
different kinds). As another example, the ability to write program codes in problem solving 
belongs to the synthesis level of the Bloom’s Taxonomy. The revised Bloom’s Taxonomy 
(composed of a revised hierarchy of create, evaluate, analyse, apply, understand and recall ) 
(Anderson et al., 2001) is used as a guideline by computer science studies, such as ACM 
(Association for Computing Machinery) and IEEE (IEEE Computer Society), for developing their 
computer science curriculum and programming education in general. Use of Bloom’s Taxonomy 
ensures that learning goals set in the introductory programming courses are cognitively 
challenging. Given that developing the skill of being able to read and design programs is a key 
focus of computer science education, it is likely that some proportion of the high failure rate in 
introductory programming courses may be attributed to the difficulty in setting optimal learning 
goals and appropriate assessment instruments which outlines the importance of this study. 

Conceptual Framework 

Figure 1 summarises learning goals from both the student’s and the teacher’s point of view based 
on the previous. Defining learning goals is used to enhance learning outcomes and motivate 
learning. For them to be effective, the implementation of these goals should be monitored and 
controlled according to the course demand and learning contexts. In some cases, learning goals are 
used interchangeably with performance goals and learning outcomes. Research results show that 
the student’s age, prior experiences and attitude towards learning, preference in the course delivery 
format and the average study period are the main explanatory factors behind different learning 
outcomes (Lim & Morris, 2009; Xia, 2013; Xia & Liitiainen, 2016). 



Defined 


Context- 

Dependent 


Performance- 

oriented 


Figure 1. Factors that affect learning goals 
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The different aspects of learning goals in programming education are: 

• Specific, task-involved: Specific, proximal and challenging goals enhance self-efficacy and 
improved performance (Eccles & Wigfield, 2002). 

• General, broadly defined: While learning goals are found to have an effect on performance, 
depending on the task complexity, one could emphasize the broader context of programming 
languages and the programming community. In this case, learning goals can be general and 
broadly defined (Nahrgang et ah, 2013). 

• Academic: Learning goals play a decisive role in determining the quality of learning. In order 
to affect the learning performance of the students, different levels of academic goals can be set 
depending on the task in question, the learning environment and the learning beliefs (Valle et 
ah, 2009). 

• Context-dependent: Factors that contribute to goal setting include its relation to self-efficacy 
and its effect across students, time, tasks and other dependent variables. Goals are set in order 
to reach a specific performance outcome (Locke & Latham, 2006). 

• Active, achievement-oriented: Achievement goals are used to motivate learning and are used 
in achievement settings. Active learning goals are used for active coping, long-lasting 
motivation and high achievement in face of challenges (Grant & Dweck, 2003). 

• Performance-oriented: Performance goals enhance learning and are linked to learning-related 
outcomes. The focus of performance goals is to demonstrate one’s competence, while the 
focus of mastery goals is to develop one’s competence (Linnenbrink, 2005). 

• Intrinsic, internal: Goals represent individual internal wishes and desire and are closely 
related to the need to achieve. As goals reflect individual motivation, implicit motives are 
closely related to explicit goals, which are then linked to individual performance (Pintrich, 
2003). 

Moreover, a programming education environment that considers the needs of the students is found 
to increase successful learning outcomes especially for novice students. Such an environment 
allowing collaboration and the exchange of quality information is found to reduce the rate of the 
dropouts in programming studies (Andersen et al. 2003; Xia, 2015). 

Research design and methodology 

Salinger et al. (2008) proposed that adopting qualitative research methods in studies of teaching 
programming is more conducive to the understanding of the given process than quantitative 
methods which might produce findings that lack detail in explaining the variation of experiences. 

In this study, qualitative research was especially useful in deriving meanings from objective 
conceptual descriptions of the programming experience. It was chosen because the aim was to 
capture individual student’s experience of programming education. Lemke (2012) stated that, in 
educational research, the analysis and processing of verbal data can be done using content analysis 
in order to classify patterns, concepts and interactions. Further, Mayring (2000) suggested content 
analysis as the central method in analysing interview transcripts and it has been used in this study 
as a valid and effective method for making meaningful inferences from the given text data via 
stepwise analysis. It is also held that content analysis is appropriate where the research question is 
specific and that a step-by-step analysis is deemed appropriate, which is the case in this study. 

Course data from introductory programming courses from the Aalto University in Finland was 
collected for a total of five years (2009-2013). The introductory programming course is offered 
twice per year, that is, in each of two academic semesters (Spring and Autumn/Fall). In 2013, the 
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introductory programming course, which aimed to teach students the Python programming 
language, consisted of 4 hours of lecturers, 32 hours of self-learning, 77 hours of exercises and 20 
hours reserved for the exam and exam preparation. The students, predominantly from first and 
second year, had access to printed materials, the course book and an online forum. In 2009, data 
was collected from 461 students; in 2010 from 390 students; in 2011 from 363 students; in 2012 
from 229 students; and in 2013 from 212 students. 

The aim was to collect data about these programming students including their background, 
motivation, choice of major and their experiences in programming. The data from these students 
has provided valuable feedback on the quality of teaching in programming education as well as the 
students’ learning preferences. The students were given the chance to freely express themselves 
after the course was completed. These open responses were transcribed into a text and analysed in 
order to capture the variation in the students’ experience in programming education in response to 
the research question, that is: What are the different factors that affect the kind of learning goals 
students set for themselves in programming education. The analysis adopted an iterative process 
and aimed to capture the pedagogical patterns evident in the verbal data. It is acknowledged that 
content analysis is context-dependent. This process also invites selection bias problems. 
Nevertheless, inductive content analysis is useful as a method for us to study in depth the 
underlying construction of the given phenomenon. 

Results 

Table 1 presents a classification of the different factors that affect the kind of learning goals that 
students set for themselves in programming education based on the students’ experiences. It is 
important to note that the classification of learning goals in Table 1 is based on the feedback 
results and takes into account the student background and the direct quotes are only excerpts from 
the extended survey. The example excepts are intended to reveal the student profiles of our 
research and were translated from the original language from the course survey. Based on the 
research results, it is seen that learning goals are, in general, positively affected by interests in 
programming, background in computer science, personality traits, cognitive abilities and personal 
attitude towards the programming courses. In addition, we see that learning goals vary by nature 
and are dependent on the students’ expectation and motivation towards programming. Moreover, 
learning goals can also be broken down into smaller more digestible forms at different stage of 
learning. For students with no prior background in computer science, programming is found to be 
a difficult skill to leam, and thus having well-defined learning goals is found to support learning. 
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Table 1. Factors that affect learning goals and learning outcomes in programming education 


Aspects 


Learning Goals 


Example Student Excerpts 


Prior Experience Students with prior 

experience in computer 
science set internal goals 
to learn more. 


Engineering Students having an 

Background engineering background 

find the learning goals of 
programming to be 
encouraging. 


• In my opinion, a lecture should not waste 
time on independent learning. ... because 
advanced students with prior knowledge 
often have to wait for the beginners when 
exercises are solved at their own pace. 

• The lecture notes from the course had all 
the necessary information I needed as well 
as plenty> of good exercises. Because of this, 
I rarely needed to use other types sources 
for my learning. 


Personality 


Students who are 
intrinsically driven set 
challenging goals and are 
interested in developing 
and extending their own 
learning. 


The programming tool was amazing. It 
allowed effective distance learning and 
presented the exercises clearly. It was great 
that the tool also gave feedback on where I 
made mistakes and where to improve. 


Academic 

Background 


Students with a strong 
academic background set 
learning goals based on a 
demand for both skills 
and grades. 


The exam required plenty of information to 
be remembered by heart that was almost 
impossible. However, the course also 
taught a lot of new and useful knowledge to 
students who have never programmed 
before. 


Interests 


Students with interests in 
computer science set 
realistic goals that 
motivate their studies. 


The lectures were really clear and useful. If 
I had participated in all of the lectures, I 
would surely have learned everything. 


Cognitive Ability Goal setting in 

programming may use 
cognitive abilities such 
as analytical thinking. 


Quality of Teaching Active goals set by the 
lecturer aid learning. 
These goals can be set at 
different stages of 
learning. 


Student Expectation Goals set by the students 
may differ from the 
goals set by the lecturer 
as students may have 
different expectations for 
the course. 


• The last part of the programming exercises 
was extremely challenging. I had to use a 
tremendous amount of mathematical 
thinking and wrote over 100 lines of codes 
to solve it. 

• The lecture was well presented and 
extremely clear even for me as a beginner 
in programming. The lecturer did not just 
assume but really took the needs of the 
students who have never programmed 
before into consideration. 

• I participated in the first few lectures but 
they felt quite tedious and did not help me 
very much. Learning by doing was a much 
better learning format for me especially 
when it comes to the exercises. 
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Based on the results, the majority of students in our sample had prior experience with and interest 
in computers. The main reason why students chose computer science as their major is typically 
due to job demand and interest., A student’s personality was found to contribute positively to 
learning outcomes. Having strong mathematical skills from previous studies and knowledge in 
related fields are conducive to learning programming as it requires high cognitive skills and 
personal interest coupled with an intrinsic interest in extending an individual’s understanding. 

Discussion and conclusion 

Programming studies are the cornerstone of computer science. According to Carter and Jenkins 
(1999), one of the primary teaching goals of introductory programming courses is to equip 
students with basic knowledge and skills in programming. Lewis (2010) similarly confirmed that 
the goal is to develop students’ programming skills and attitude towards programming. However, 
research results have shown that a large group of students do not attain the level of skills set by the 
teaching goals of the programming courses and fail to learn programming skills at an acceptable 
level (see, for example, Dehnadi & Bornat, 2006). Robins (2010) suggested that the reasons 
behind this phenomenon remain unexplained. The results in this study have shown that students 
with different backgrounds view programming differently and have different learning preferences. 
The high failure rate of programming courses might be improved by teachers’ understanding of 
students’ expectation and learning habits in these programming courses. 

The present study investigated the factors that affect the kind of learning goals that students set for 
themselves. The main topics of this paper are students’ goal setting and educators’ intended 
learning outcomes in programming courses. The research question focused on one aspect, namely, 
factors affecting students’ goal setting. Although research about teaching and learning 
programming has been researched in detail before, the focus of this paper concentrates on the 
pedagogic aspects of learning programming from the students’ point of view via an empirical 
study, which might be considered as a new dimension. In other words, the paper potentially 
contains two interesting contributions. The first is the classification of aspects of learning goals 
based on a literature review; and, secondly, it presents findings on how different factors affect 
students’ goal setting and learning. Instructors and researchers will benefit from understanding 
students’ self-set goals so that they can deliver the appropriate content at a pace and in a form to 
match these personal goals. 

This study thus confirms Whalley et al.’s (2006) finding that learning is more successful when 
students are able to understand, reflect and synthesise on a deeper cognitive level. Having well- 
defined learning goals appears to be closely related to successful learning outcomes and students’ 
progress can be monitored and measured against the learning goals via regular feedback. In the 
present study, the concept of a learning goal is multifaceted and context-dependent. From the 
student’s point of view, goal setting is dependent on factors such as prior knowledge on the 
subject, family background, expectation and motivation towards programming. When it comes to 
future research, it would be interesting to capture the students’ perspective on the teaching 
methods and the quality of teaching in a personalised learning environment. 
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